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Objective:  We  investigated  performance,  workload,  and 
stress  in  groups  of  paired  observers  who  performed  a  vigi¬ 
lance  task  in  a  coactive  (independent)  manner. 

Background:  Previous  studies  have  demonstrated  that 
groups  of  coactive  observers  detect  more  signals  in  a  vigilance 
task  than  observers  working  alone.  Therefore,  the  use  of 
such  groups  might  be  effective  in  enhancing  signal  detection  in 
operational  situations.  However,  concern  over  appearing  less 
competent  than  one’s  cohort  might  induce  elevated  levels  of 
workload  and  stress  in  coactive  group  members  and  thereby 
undermine  group  performance  benefits.  Accordingly,  we  per¬ 
formed  the  initial  experiment  comparing  workload  and  stress 
in  observers  who  performed  a  vigilance  task  coactively  with 
those  of  observers  who  performed  the  vigilance  task  alone. 

Method:  Observers  monitored  a  video  display  for  colli¬ 
sion  flight  paths  in  a  simulated  unmanned  aerial  vehicle  control 
task.  Self-reports  of  workload  and  stress  were  secured  via  the 
NASA-Task  Load  Index  and  the  Dundee  Stress  State  Ques¬ 
tionnaire,  respectively. 

Results:  Groups  of  coactive  observers  detected  significantly 
more  signals  than  did  single  observers.  Coacting  observers  did 
not  differ  significantly  from  those  operating  by  themselves  in 
terms  of  workload  but  did  in  regard  to  stress;  posttask  distress 
was  significantly  lower  for  coacting  than  for  single  observers. 

Conclusion:  Performing  a  visual  vigilance  task  in  a  coact¬ 
ive  manner  with  another  observer  does  not  elevate  workload 
above  that  of  observers  working  alone  and  serves  to  attenu¬ 
ate  the  stress  associated  with  vigilance  task  performance. 

Application:  The  use  of  coacting  observers  could  be 
an  effective  vehicle  for  enhancing  performance  efficiency  in 
operational  vigilance. 

Keywords:  vigilance,  coacting  groups,  multiobserver  indepen¬ 
dence/dependence,  evaluation  apprehension,  workload,  stress 
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INTRODUCTION 

Vigilance  or  sustained  attention  tasks  require 
observers  to  maintain  their  focus  of  atten¬ 
tion  and  remain  alert  to  stimuli  for  prolonged 
periods  of  time  (Hancock,  2013;  Langner  & 
Eickhoff,  2013;  Warm,  Finomore,  Vidulich, 
&  Funke,  2015).  These  tasks  are  of  interest 
to  human  factors  specialists  because  they  are 
a  key  element  in  many  situations  wherein 
observers  are  required  to  scan  the  environment 
for  untoward  events  or  monitor  systems  for 
indications  of  malfunction  (Warm  et  ah,  2015). 
Among  these  settings  are  military  surveillance; 
cockpit  and  seaboard  monitoring;  air  traffic 
and  unmanned  vehicle  control;  airport,  border, 
and  cyber  security;  industrial  quality  control; 
long-distance  driving;  and  medical  functions 
involving  cytological  screening  and  the  inspec¬ 
tion  of  anesthesia  gauges  during  surgery  (Drury, 
2015;  Hancock  &  Hart,  2002;  Pop,  Stearman, 
Kazi,  &  Durso,  2012;  Sawyer  et  al.,  2014;  Vidu¬ 
lich,  Wickens,  Tsang,  &  Flach,  2010;  Warm, 
Parasuraman,  &  Matthews,  2008).  Faboratory 
studies  of  vigilance  typically  find  that  observers 
are  not  as  efficient  as  might  be  desired;  critical 
signals  for  detection  are  often  missed,  especially 
over  time  (Davies  &  Parasuraman,  1982;  Han¬ 
cock,  2013;  Warm  et  ah,  2015).  In  addition,  on 
an  operational  level,  studies  have  shown  that 
accidents  ranging  from  minor  to  major  have 
resulted  from  detection  failures  on  the  part  of 
nonvigilant  observers  (Hawley,  2006;  Langner 
&  Eickhoff,  2013;  Molloy  &  Parasuraman, 
1996).  Consequently,  there  is  a  need  to  find 
ways  to  enhance  signal  detection  in  vigilance 
FactSStergSollitoS^ntajiKaclothat  end  have  included 
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psychophysical  techniques  to  amplify  signal 
visibility,  pharmacological  aids  for  observers  in 
the  form  of  stimulant  drugs,  training  regimens 
to  foster  operator  familiarity  with  the  vigilance 
task  involved,  and  procedures  to  augment  the 
selection  of  individuals  who  are  best  suited 
for  the  task  to  be  performed  (Craig,  1984; 
Fisk  &  Schneider,  1981;  Lieberman,  Coffey,  & 
Kobrick,  1998;  Reinennan-Jones,  Matthews, 
Langheim,  &  Warm,  2011;  Warm  et  al.,  2015). 
Another  potential  solution  to  enhance  signal 
detection  is  the  use  of  groups  of  observers  rather 
than  single  individuals  under  the  assumption 
that  “two  heads  are  better  than  one”  (Wiener, 
1964).  It  is  that  solution  that  is  of  interest  in  the 
present  study. 

Williams  (1947)  first  suggested  the  use  of 
multiobserver  groups,  and  experiments  have 
shown  that  the  group  approach  can  indeed  be 
effective.  In  one  version  of  this  method,  the 
coaction  approach  (Harkins,  1987),  pairs  of 
observers  individually  monitor  a  common  dis¬ 
play  for  critical  signals  and  the  group  as  a  unit 
receives  credit  if  any  member  correctly  detects  a 
signal.  It  should  be  noted  that  the  use  of  the  term 
group  in  this  sense  is  somewhat  atypical  in  that 
it  does  not  require  collaboration  between  mem¬ 
bers  in  performing  the  task  (DeLamater,  1974). 
As  described  by  Wiener  (1964),  the  coaction 
arrangement  can  be  thought  of  as  a  “parallel 
switching  circuit”  in  which  the  system  will  react 
if  at  least  one  member  of  the  group  responds. 
Several  experiments  have  shown  that  this 
approach  lets  the  group  outperform  single  moni¬ 
tors  in  regard  to  signal  detection  (Harkins,  1987; 
Klinger,  1969;  Morgan  &  Alluisi,  1965;  Schafer, 
1949;  Waag  &  Halcomb,  1972;  Wiener,  1964). 
Morgan  and  Alluisi  (1965)  and  Wiener  (1964) 
have  accounted  for  the  enhanced  performance  of 
the  coacting  group  by  an  independent  events 
model  in  which  enhanced  group  performance  is 
asserted  to  result  from  the  application  of  the 
rules  for  combining  simple  probabilities  with 
the  assumption  that  the  performances  of  the 
group’s  observers  are  independent.  If  this  is  the 
case,  these  authors  point  out  that,  using  the  mean 
detection  rate  of  a  control  group  of  individual 
observers  (pm)  as  an  estimate  of  the  detection 
probability  of  a  hypothetical  single  observer,  the 
independent  events  model  predicts  that  the 


detection  probability  of  a  two-observer  coacting 
group  should  be  the  following: 

1  -  (1  ~Pmf-  (1) 

Employing  Equation  1 ,  the  mean  detection  rate 
of  the  control  observers  exactly  predicted  the 
mean  detection  rate  of  the  coacting  groups  in 
both  Morgan  and  Alluisi’s  (1965)  and  Wiener’s 
(1964)  studies. 

Although  the  independent  events  model 
accounts  for  the  enhanced  detection  performance 
of  the  coacting  vigilance  group,  this  does  not  nec¬ 
essarily  tell  the  complete  story  of  coacting  group 
dynamics  in  regard  to  vigilance  tasks.  There  are 
other  dimensions  of  observer  experience  in  a  vigi¬ 
lance  task  that  could  potentially  paint  a  different 
picture.  Those  aspects  are  perceived  mental  work¬ 
load  and  stress.  There  is  substantial  evidence 
showing  that  the  need  to  sustain  attention  imposes 
a  high  mental  workload  on  operators,  who  also 
find  tasks  requiring  such  attention  highly  stressful 
(Warm,  Parasuraman  et  al.,  2008;  Warm  et  al., 
2015).  Studies  of  the  cognitive  demands  of  vigi¬ 
lance  tasks  have  employed  the  NASA-Task  Load 
Index  (NASA-TLX;  Hart  &  Staveland,  1988), 
which  is  considered  one  of  the  most  effective  mea¬ 
sures  of  perceived  mental  workload  currently 
available  (Wickens,  Hollands,  Banbury,  &  Para¬ 
suraman,  2013).  It  provides  a  measure  of  global  or 
overall  workload  on  a  scale  of  0  to  100  and  identi¬ 
fies  the  relative  contributions  of  six  sources  of 
workload,  three  of  which  reflect  the  demand  that  a 
task  places  on  operators — mental,  physical,  and 
temporal  demand — and  three  of  which  character¬ 
ize  the  interactions  between  observers  and  the  task 
confronting  them — performance,  effort,  and  frus¬ 
tration.  Several  studies  using  the  NASA-TLX 
have  shown  that  global  workload  scores  in  vigi¬ 
lance  tasks  typically  fall  above  the  midpoint  of  the 
scale,  indicating  a  high  level  of  mental  workload, 
and  that  mental  demand  and  temporal  demand  are 
among  the  primary  components  of  this  workload 
(Finomore,  Shaw,  Warm,  Matthews,  &  Boles, 
2013;  Warm,  Dember,  &  Hancock,  1996;  Warm 
et  al.,  2015;  Warm,  Matthews,  &  Finomore,  2008; 
Warm,  Parasuraman  et  al.,  2008). 

The  elevated  workload  of  vigilance  tasks  is 
accompanied  by  amplified  levels  of  stress  as 
revealed  through  physiological  and  self-report 
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measures  (Warm  et  al.,  2015).  One  self-report 
measure  that  has  been  used  extensively  in  vigi¬ 
lance  studies  and  is  featured  in  this  study  is  the 
Dundee  Stress  State  Questionnaire  (DSSQ;  Mat¬ 
thews  et  al.,  2002).  As  described  by  Funke  (2007), 
the  DSSQ  is  a  96-item,  experimentally  validated 
measure  designed  to  assess  transient  states  associ¬ 
ated  with  task  engagement,  distress,  and  worry. 
Typical  results,  summarized  in  Matthews,  Szalma, 
Panganiban,  Neubauer,  and  Warm  (2013)  and 
Warm,  Matthews  et  al.  (2008),  have  indicated  that 
participation  in  a  vigilance  task  leads  to  a  loss  of 
task  engagement  and  increased  feelings  of  distress. 

Social  facilitation  research  has  shown  that  an 
important  element  in  coaction  group  functioning 
is  “evaluation  apprehension,”  wherein  the  pos¬ 
sibility  of  having  their  responses  identified  and 
appraised  leads  group  members  to  be  concerned 
with  appearing  to  be  incompetent,  particularly 
with  regard  to  their  cohorts  (Bond  &  Titus,  1983; 
Harkins,  1987).  Consequently,  in  the  case  of 
group  vigilance,  evaluation  apprehension  could 
lead  group  members  to  work  harder  than  single 
observers  and  to  experience  greater  task-induced 
workload  and  stress.  Such  an  effect  would  be  an 
important  operational  concern,  as  stress  reduces 
an  individual’s  productivity,  safety,  and  health 
(Hancock  &  Warm,  1989;  Huey  &  Wickens, 
1993;  Miller,  Chen,  &  Zhou,  2007;  Nickerson, 
1992;  Strauch,  2002)  and  might  therefore  coun¬ 
termand  the  signal  detection  benefits  derived 
from  group  coaction.  Accordingly,  the  goal  for 
this  study  was  to  determine  if  the  heightened 
level  of  signal  detection  expected  in  group  vigi¬ 
lance  is  accompanied  by  elevated  workload  and 
stress  reactions  among  group  members. 

METHOD 

Participants 

Fifty-one  individuals,  3 1  men  and  20  women, 
recruited  from  the  Dayton,  Ohio  area  served  as 
observers  for  a  single  payment  of  $30.  Over¬ 
all,  the  observers  ranged  in  age  from  18  to  30 
years,  with  a  mean  age  of  22.10  years  and  a 
standard  deviation  of  3.04  years.  As  indicated 
by  self-reports,  all  observers  had  normal  or 
corrected-to-nonnal  vision  and  normal  hearing. 
The  experiment  was  conducted  under  condi¬ 
tions  approved  by  the  Wright-Patterson  Air 
Force  Base  Institutional  Review  Board. 


Experimental  Design 

A  2  (Observer  Condition:  Single-Observer, 
Coacting  Groups)  x  4  (Periods  of  Watch)  split- 
plot  experimental  design  was  employed.  Sev¬ 
enteen  observers  (11  men  and  6  women)  were 
assigned  at  random  to  a  single-observer  condi¬ 
tion,  and  34  observers  (20  men  and  14  women) 
were  paired  to  form  17  coacting  groups.  Group 
pairings  were  determined  at  random  with  the 
restriction  that  the  members  of  all  dyads  were 
of  the  same  sex  and  had  no  prior  acquaintance 
with  each  other.  To  ensure  that  age  differences 
were  not  a  confounding  factor  in  the  design  of 
this  study,  we  compared  the  mean  ages  of  the 
single-observer  (M  =  23.06  years,  SD  =  3.23) 
and  the  coacting  group  (M=  21.62  years,  SD  = 
2.82)  conditions  and  found  that  they  were  not 
significantly  different  from  each  other  (p  >  .05). 
We  also  examined  age  differences  within  the 
dyads  of  the  coacting  group  observer  condition 
and  found  that  they  were  minimal  {Mdifference  = 
3.24  years,  SD  =  2.80  years).  Observers  in  all 
conditions  participated  in  a  40-min  vigilance 
session  divided  into  four  continuous  10-min 
periods. 

Vigilance  Task 

Observers  were  told  that  they  would  be 
assuming  the  role  of  either  a  single  unmanned 
aerial  vehicle  (UAV)  monitor  (single-observer 
condition)  or  a  member  of  a  dyadic  group  of 
UAV  monitors  (coacting  group  condition).  This 
was  done  to  enhance  the  observers’  interest  and 
motivation  in  the  vigilance  task  they  were  to 
perform.  It  was  not  meant  to  simulate  an  opera¬ 
tional  UAV  control  environment  or  to  focus  the 
experiment  specifically  on  UAV  control.  In  both 
the  single-observer  and  coacting  group  condi¬ 
tions,  observers  were  tasked  with  monitoring 
the  flight  pattern  of  a  squadron  of  four  UAVs 
projected  in  the  center  of  a  43.18-cm  visual 
display  terminal  (VDT)  as  shown  in  Figure  1. 
The  display,  adapted  from  Dillard  et  al.  (2014), 
Funke  et  al.  (2011),  and  Shaw  et  al.  (2013), 
contained  a  single  circular  viewing  field,  10.19 
cm  in  diameter,  presented  on  a  gray  background 
(transluminance  =  42  cd/m2).  The  viewing  field 
consisted  of  three  concentric  circles.  The  diam¬ 
eters  of  the  small  and  middle  circles  were  2.54 
cm  and  6.35  cm,  respectively.  The  largest  circle 
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Figure  1.  Examples  of  neutral  events  and  critical  signals  in  the  display  (adapted  from 
Dillard  et  al.,  2014;  Funke  et  al.,  2011;  Shaw  et  al.,  2013). 


formed  the  exterior  black  border  of  the  viewing 
field,  which  was  divided  into  four  equal  90° 
quadrants  defined  by  black  lines.  In  all  cases, 
the  lines  defining  the  viewing  field  were  .32  cm 
thick,  their  trans luminance  was  37  cd/m2,  and 
their  contrast  with  the  gray  background  based 
on  the  Michaelson  Contrast  ratio  (Coren,  Ward, 
&  Enns,  1999)  was  6.33%. 

Normally,  the  quadrants  of  the  viewing  field 
were  blank.  When  activated,  each  quadrant  of 
the  display  contained  a  black  triangular  icon 
(base  =  1.35  cm;  altitude  =  .95  cm;  translumi¬ 
nance  =  37  cd/m2;  contrast  with  the  gray  back¬ 
ground  =  6.33%),  which  represented  a  UAV.  The 
flight  orientation  of  the  squadron  of  UAVs, 
clockwise  or  counterclockwise  (defined  by  the 
“noses”  of  the  UAVs),  was  random  throughout 
the  vigil  with  the  restriction  that  they  occurred 
equally  often  across  stimulus  presentations. 
Critical  signals  for  detection  were  cases  in  which 
one  of  the  UAV s  was  flying  in  an  inappropriate 
direction  relative  to  the  others  so  that  a  collision 
could  occur.  Neutral  events  (i.e.,  stimuli  requir¬ 
ing  no  overt  observer  responses)  and  critical  sig¬ 
nals  in  the  clockwise  and  counterclockwise 
flight  paths  are  illustrated  in  Figure  1. 

In  both  experimental  conditions,  the  display 
was  updated  30  times  per  minute  (one  stimulus 
event  every  2,000  ms)  with  an  exposure  time  of 
1,000  ms.  Sixteen  critical  signals  occurred  at 
random  intervals  during  each  10-min  period  of 
watch  (four  in  each  display  quadrant,  two  clock¬ 
wise  and  two  counterclockwise;  overall  signal 
probability  =  .053).  Observers  in  both  condi¬ 
tions  were  allowed  2,000  ms  from  the  onset  of  a 
critical  signal  to  respond  by  pressing  the  space 
bar  on  a  computer  keyboard.  Failures  to  respond 
within  that  window  were  counted  as  errors  of 


omission  (misses);  all  other  responses  were  con¬ 
sidered  errors  of  commission  (false  alarms). 

A  “parallel”  decision  rule  was  adopted  to 
determine  correct  detections  in  the  coacting 
group  condition  (Waag  &  Halcomb,  1972;  Wie¬ 
ner,  1964).  Under  this  rule,  the  group  received 
credit  for  a  correct  detection  if  either  member 
detected  a  critical  signal  and  was  penalized  with 
a  false  alarm  if  either  member  made  a  commis¬ 
sion  error.  This  scoring  approach  could  lead  to 
inflated  correct  detection  and  false  alarm  rates  if 
both  observers  in  a  pair  responded  to  the  same 
stimulus  events.  To  counter  such  problems,  the 
following  recording  rules  were  observed:  If  both 
observers  made  a  correct  detection  within  the 
appropriate  time  frame,  only  the  fastest  response 
was  accepted  as  a  correct  detection  and  included 
in  group  scoring.  Likewise,  if  both  group  mem¬ 
bers  made  an  error  of  commission  to  the  same 
noncritical  signal  event,  the  fastest  response  was 
counted  as  a  group  false  alarm  and  the  slower 
response  was  not  included  in  group  scoring.  In 
cases  in  which  both  group  members  failed  to 
respond  to  a  critical  signal,  the  group  was 
charged  with  a  miss. 

Procedure 

Upon  reporting  to  the  laboratory,  observers 
surrendered  their  time  pieces  and  cell  phones 
and  signed  an  informed  consent  form.  They 
were  unaware  of  the  length  of  the  vigil  other 
than  it  would  not  exceed  1  hr. 

In  the  single-observer  condition,  observers  per¬ 
formed  the  vigilance  task  alone  and  consequently 
were  solely  responsible  for  identifying  potential 
collisions  between  the  UAVs.  Observers  in  the 
coacting  group  condition  were  seated  adjacent  to 
each  other  in  the  same  room,  separated  by  an 
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opaque  divider.  They  were  provided  with  identical 
display  terminals  and  keyboards  with  which  to 
complete  the  vigilance  task.  Coactors  were  aware 
of  each  other’s  presence  in  the  room  and  were 
informed  that  although  they  would  be  jointly 
responsible  for  signal  detection  on  the  same  task, 
they  were  not  to  communicate,  collaborate,  or 
strategize.  Apart  from  the  direction  not  to  commu¬ 
nicate  with  the  other  member  of  the  group,  coac¬ 
tors  were  given  identical  instructions  to  that  of  the 
single-observers.  The  arrangement  of  the  testing 
room  prohibited  coactors  from  acquiring  knowl¬ 
edge  of  the  accuracy  of  their  cohort’s  responses.  In 
both  experimental  conditions,  the  vigilance  task 
was  administered  in  a  quiet  (ambient  sound 
level  =  40  dBA)  1.78  x  2.41  x  2.67  m  windowless 
laboratory  room.  The  VDT  was  mounted  on  a 
table  99.10  cm  directly  in  front  of  the  seated 
observer.  Ambient  illumination  in  the  testing  room 
was  5  cd/m2.  It  was  provided  by  a  50-watt  incan¬ 
descent  bulb  dimmed  to  half  power  and  positioned 
above  and  behind  the  seated  observer(s)  to  mini¬ 
mize  glare. 

To  ensure  comprehension  of  instructions  and 
the  ability  to  detect  critical  signals,  each  observer 
received  an  individual  10-min  training  vigil 
immediately  prior  to  the  initiation  of  the  main 
vigil,  which  duplicated  the  signal  presentation 
conditions  of  the  main  vigil.  To  facilitate  the  dis¬ 
crimination  of  critical  signals  during  training,  a 
computerized  female  voice  provided  feedback 
as  to  correct  detections,  misses,  and  false  alarms. 
The  use  of  a  female  voice  in  this  regard  is  con¬ 
sistent  with  studies  indicating  that  voiced  warn¬ 
ing  signals  are  perceived  to  be  more  urgent  when 
spoken  in  a  female  than  a  male  voice  (Barzegar 
&  Wogalter,  1 998;  Hollander  &  Wogalter,  2000). 
Observers  were  required  to  detect  11  of  the  16 
presented  critical  signals  and  make  no  more  than 
10  false  alarms  during  training  in  order  to  con¬ 
tinue  in  the  experiment.  All  observers  met  these 
requirements  on  the  first  attempt.  Feedback  was 
not  provided  during  the  main  vigil.  Upon  its 
completion,  observer  workload  was  assessed 
using  the  NASA-TLX.  The  DSSQ  was  adminis¬ 
tered  prior  to  the  training  phase  and  at  the  con¬ 
clusion  of  the  main  vigil  to  gauge  task-induced 
stress.  Computerized  versions  of  both  instru¬ 
ments  were  employed. 
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Figure  2.  Mean  proportions  of  correct  detections  in 
the  single-observer  and  coacting  group  conditions  by 
periods  of  watch.  Error  bars  are  standard  errors. 


RESULTS 

Performance  Efficiency 

The  focus  of  interest  in  regard  to  performance 
efficiency  was  on  differences  between  single 
observers  and  coacting  groups.  Consequently, 
in  regard  to  performance,  the  units  of  analysis 
were  individual  observers  in  the  single-observer 
condition  and  observer  groups  in  the  coacting 
condition.  In  both  cases,  N=\l. 

Correct  detections.  Mean  proportions  of  cor¬ 
rect  detections  in  the  single-observer  and  coact¬ 
ing  group  conditions  are  plotted  as  a  function  of 
periods  of  watch  in  Figure  2. 

It  is  evident  in  the  figure  that  detections  were 
greater  in  the  coacting  group  condition  than  in 
the  single-observer  condition  and  that  the  fre¬ 
quency  of  signal  detections  remained  stable  over 
time.  These  impressions  were  confirmed  by  a  2 
(Conditions)  x  4  (Periods  of  Watch)  mixed- 
model  analysis  of  variance  (ANOVA)  of  the  arc¬ 
sines  of  the  proportion  of  correct  detection 
scores.  The  arcsine  transform  was  employed  to 
normalize  the  data  (Kirk,  1995).  The  ANOVA 
revealed  that  the  coacting  group  detected  sig¬ 
nificantly  more  signals  (M  =  .82,  SE  =  .023)  than 
did  single  observers  (M  =  .57,  SE  =  .050),  F(l, 
32)  =  17.51,/?  <  .001,  qp2  =  .35.  The  main  effect 
for  periods  of  watch  was  not  statistically  signifi¬ 
cant  (p  =  .15),  nor  was  the  Conditions  x  Periods 
interaction  (p  =  .54).  In  this  and  all  subsequently 
reported  ANOVAs,  the  Box  correction  (Maxwell 


Downloaded  from  hfs.sagepub.com  at  HFES-Human  Factors  and  Ergonomics  Society  on  August  24,  2016 


DISTRIBUTION  STATEMENT  A.  Approved  for  public  release. 


Cleared,  88PA,  Case  #2016-1888. 


920 


September  201 6  -  Human  Factors 


Figure  3.  Mean  proportions  of  false  alarms  in  the 
single-observer  and  coacting  group  conditions  by 
periods  of  watch.  Error  bars  are  standard  errors. 

&  Delaney,  2004)  was  employed  when  appropri¬ 
ate  to  compensate  for  violations  of  the  sphericity 
assumption. 

Following  the  procedure  outlined  by  Morgan 
and  Alluisi  (1965)  and  Wiener  (1964),  the  mean 
detection  rate  of  the  group  of  individual  observ¬ 
ers  {pm  =  .57)  was  used  as  an  estimate  of  the 
detection  probability  of  a  hypothetical  single 
observer  in  Equation  1  to  predict,  on  the  basis  of 
the  independent  events  model,  the  mean  detec¬ 
tion  probability  of  the  coacting  groups.  Equation 
1  forecasts  that  value  to  be  .82,  and  that  is  the 
precise  value  obtained  for  those  groups. 

False  alarms.  Mean  proportions  of  false 
alanns  in  the  single-observer  and  the  coacting 
group  conditions  are  plotted  as  a  function  of 
periods  of  watch  in  Figure  3. 

A  2  (Conditions)  x  4  (Periods  of  Watch) 
mixed-model  ANOVA  of  the  arcsines  of  the  pro¬ 
portions  of  false  alarms  revealed  a  statistically 
significant  main  effect  of  period  of  watch, 
F{ 2.02,  70.48)  =  7.52,  p  <  .001,  qp2  =  .19.  Nei¬ 
ther  the  main  effect  of  conditions  (p  =  .83)  nor 
the  Conditions  x  Periods  interaction  (p  =  .78) 
were  statistically  significant.  Across  the  experi¬ 
mental  conditions,  the  probability  of  a  false 
alann,  which  was  low  to  begin  with,  declined 
with  time-on-task  (Ms  for  Periods  1-4  =  .016, 
.012,  .010,  and  .007;  SEs  =  .003,  .002,  .002,  and 
.002,  respectively). 

Intragroup  performance.  A  potentially 
important  question  that  could  be  asked  in  regard 
to  group  performance  in  this  experiment  is 


whether  the  correct  detection  and  false  alarm 
rates  in  the  dyads  were  driven  to  a  greater  degree 
by  a  single  observer  due  to  differences  in  speed 
of  responding.  To  answer  that  question,  we  iden¬ 
tified  individuals  in  each  dyad  who  on  average 
had  the  fastest  and  slowest  speed  of  response  for 
correct  detections  and  individuals  in  each  dyad 
who  had  the  fastest  and  slowest  speed  of 
response  for  false  alarms.  There  were  no  signifi¬ 
cant  differences  between  “fast”  and  “slow” 
observers  in  either  the  proportion  of  the  groups’ 
correct  detections  or  the  proportion  of  the 
groups’  false  alarms  (p  >  .05  in  each  case),  indi¬ 
cating  that  observers  in  the  dyads  performed 
similarly  and  no  one  individual  in  a  given  dyad 
was  primarily  responsible  for  correct  detections 
or  false  alarms. 

Workload  and  Stress 

Unlike  the  case  of  performance  efficiency, 
where  the  focus  of  interest  was  on  groups  of 
coacting  observers,  the  focus  of  interest  in 
regard  to  workload  and  stress  was  on  the  indi¬ 
vidual  observers  themselves.  Therefore,  the 
units  of  analysis  in  the  statistical  tests  used  in 
conjunction  with  the  workload  and  stress  mea¬ 
sures  were  the  individual  observers  in  both  the 
single-observer  (V  =  17)  and  coacting  group 
(V  =  34)  conditions. 

Mental  workload.  Workload  scores  on  each 
of  the  six  subscales  of  the  NASA-TLX  were 
determined  using  the  unweighted  scoring  proce¬ 
dure  recommended  by  Nygren  (1991).  Mean 
workload  ratings  in  both  conditions  and  for  each 
subscale  are  presented  in  Table  1 . 

As  can  be  seen  in  the  table,  the  global  work¬ 
load  rating  for  both  experimental  conditions 
(M=  55.65)  fell  above  the  midpoint  of  the  scale 
(50),  indicating  that  observers  generally  found 
the  assignment  to  be  demanding.  A  2  (Condi¬ 
tions)  x  6  (Subscales)  mixed-model  ANOVA  was 
performed  on  the  workload  data.  The  presence  of 
unequal  Vs  was  accounted  for  by  the  use  of  Type 
III  sums  of  squares,  which  are  invariant  to  cell 
frequencies  and  hence  can  be  used  with  both  bal¬ 
anced  (equal  V)  and  unbalanced  (unequal  N) 
designs  (Field,  2005).  The  analysis  revealed  a 
significant  main  effect  for  subscale,  F( 3.87, 
190.41)  =  46.20,  p  <  .001,  r)p2  =  .485.  Neither  the 
main  effect  of  experimental  condition  (p  =  .28) 
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TABLE  1:  Mean  NASA-TLX  Subscale  Scores  (and  Associated  Standard  Errors)  for  Each  Task  Condition 


Subscale 


Observer 

Condition  MD  PD  TD  P  E  F  Global 


Single  67.06  (7.84) 

observer 

Coacting  72.74  (3.82) 
group 

Mean  69.90  (3.62) 


17.65(6.36)  81.88(4.78) 
18.00  (3.62)  71.35(4.27) 
17.82(3.17)  76.62(3.31) 


56.18(5.48)  72.94(5.59) 
48.76  (3.87)  67.29  (3.76) 
52.47(3.17)  70.12(3.11) 


50.88  (5.84)  57.76  (3.48) 
43.09(4.23)  53.54(2.12) 
46.99(3.43)  55.65(1.83) 


Note.  E  =  effort;  F  =  frustration;  MD  =  mental  demand;  P  =  performance;  PD  =  physical  demand;  TD  =  temporal 
demand. 


nor  the  Condition  x  Subscale  interaction  (p  = 
.47)  was  statistically  significant.  Regarding  the 
subscale  main  effect,  a  post  hoc  Tukey’s  honestly 
significant  difference  test  (HSD;  a  =  .05,  critical 
difference  =  12.27)  indicated  that  observers  per¬ 
ceived  mental  demand,  temporal  demand,  and 
effort  to  be  the  greatest  contributors  to  their 
experience  of  workload.  The  scores  for  these 
subscales,  which  did  not  differ  significantly  from 
each  other,  were  significantly  greater  than  those 
for  each  of  the  remaining  subscales. 

Stress  state.  Scores  for  the  factors  of  the 
DSSQ  (task  engagement,  distress,  and  worry) 
were  calculated  in  the  manner  proscribed  by  the 
developers  of  the  scale  (Matthews  et  al.,  2002); 
that  is,  standardized  values  (M=  0,  SD  =  1)  were 
calculated  using  normative  data. 

Task-induced  stress  was  indexed  for  each 
observer  in  the  single  and  coacting  group  condi¬ 
tions  in  the  form  of  change  scores  (postvigil  minus 
previgil)  for  each  DSSQ  scale.  Mean  change 
scores  from  pre-  to  postvigil  for  each  DSSQ  sub¬ 
scale  are  presented  for  the  single-observer  and 
coacting  group  conditions  in  Figure  4. 

To  establish  that  the  stress  state  of  observers 
changed  significantly  as  a  result  of  performing 
the  vigilance  task,  separate  t  tests  were  com¬ 
puted  within  each  DSSQ  subscale  comparing 
the  mean  change  score  for  each  of  the  two 
experimental  conditions  against  a  value  of  zero 
(zero  indicating  no  change  from  pre-  to  postex¬ 
periment).  Within  each  subscale,  the  two  t  tests 
were  Bonferroni-corrected  with  alpha  set  at  .05. 
No  significant  changes  in  regard  to  the  Worry 
subscale  were  noted  for  the  single-observer  or 
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Figure  4.  Mean  DSSQ  change  scores  in  each  task 
condition  by  subscale.  Scores  marked  with  asterisks 
indicate  change  scores  that  are  significantly  different 
from  zero.  Error  bars  are  standard  errors. 


the  coacting  group  conditions  {p  =  .88  and  .54, 
respectively).  On  the  other  hand,  significant 
declines  in  task  engagement  were  obtained  for 
both  observer  conditions,  tsingle  observer(16)  =  3.61, 
p  <  .0\,d=  1.80,  and  tcoactlnggroup(33)  =  5.78,/?  < 
.001,  z/  =  2.01,  and  there  were  significant  increases 
in  distress  for  both  conditions,  tsmgle.observer  (16)  = 
4.50,/?  <  .001,  d= 2.25,  and  icoactmggroup(33)  =  2.47, 
p  =  .02,  d=  .86. 

To  further  examine  differences  in  stress 
response  to  the  vigilance  task,  separate  t  tests  were 
computed  comparing  change  scores  for  task 
engagement  and  distress  between  observers  in  the 
single-observer  and  coacting  group  conditions 
(worry  was  omitted  from  these  tests  because 
change  scores  for  this  measure  did  not  signifi¬ 
cantly  differ  from  zero  in  either  condition).  The 
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results  of  the  analysis  of  task  engagement  indi¬ 
cated  that  observers  in  both  conditions  reported 
similar  declines  (p  =  .49).  In  regard  to  distress, 
however,  the  analysis  revealed  a  statistically  sig¬ 
nificant  difference  between  observer  conditions, 
449)  =  2.76,  p  <  .01,  d  =  .84;  observers  working 
alone  reported  an  increase  in  distress  (M  =  .95) 
that  was  over  three  times  greater  than  that  experi¬ 
enced  by  coacting  observers  (M=  .30).  In  terms  of 
Cohen’s  (1988)  criteria  for  interpreting  effect  size, 
the  group  effect  represents  a  large  effect. 

DISCUSSION 

Consistent  with  earlier  investigations  (Har¬ 
kins,  1987;  Klinger,  1969;  Morgan  &  Allu- 
isi,  1965;  Schafer,  1949;  Waag  &  Halcomb, 
1972;  Wiener,  1964),  coacting  groups  detected 
significantly  more  critical  signals  on  a  vigi¬ 
lance  task  than  individual  observers  working 
alone.  In  respect  to  that  performance  difference, 
the  results  of  this  study  support  Morgan  and 
Alluisi’s  (1965)  and  Wiener’s  (1964)  inference 
that  signal  detections  of  coacting  observers  are 
operationally  independent,  as  the  formula  for 
calculating  observer  independence  in  group 
performance  (i.e.,  Equation  1)  exactly  predicted 
the  mean  detection  rate  of  coacting  observers. 

Although  the  coacting  group  approach  clearly 
increases  critical  signal  detection,  this  benefit 
needs  to  be  considered  with  some  caution.  As 
noted  by  Wiener  (1964),  Equation  1  predicts  that 
false  alarm  rates  will  be  higher  for  coacting 
groups  than  for  individual  observers.  This  did 
not  occur  in  the  present  study;  the  false  alarm 
rates  of  the  single-observer  and  coacting  group 
conditions  were  comparably  low  and  declined  in 
a  similar  manner  over  time.  The  absence  of 
higher  false  alarm  rates  in  coacting  groups  was 
also  reported  by  Klinger  ( 1 969)  and  Morgan  and 
Alluisi  (1965),  but  higher  false  alarm  rates  for 
coacting  groups  were  observed  in  the  studies  by 
Waag  and  Halcomb  (1972)  and  Wiener  (1964). 
Evidently,  although  a  higher  commissive  error 
rate  in  groups  of  coacting  observers  does  not 
always  occur,  it  is  a  possibility  to  be  kept  in 
mind  in  regard  to  the  benefits  of  the  coacting 
group  approach  for  the  augmentation  of  vigi¬ 
lance  performance. 

With  regard  to  performance  efficiency, 
the  algorithm  for  the  calculation  of  observer 


independence  focused  on  the  total  number  of 
signals  detected  in  the  course  of  a  vigil.  How¬ 
ever,  a  major  characteristic  of  vigilance  tasks  is 
that  signal  detection  declines  over  time,  a  phe¬ 
nomenon  known  as  the  vigilance  decrement 
(Davies  &  Parasuraman,  1982;  Hancock,  2013; 
Warm  et  al.,  2015).  One  might  ask  if  the  benefits 
of  the  coacting  group  approach  extend  not  only 
to  the  total  number  of  signals  detected  but  to  the 
vigilance  decrement  as  well;  that  is,  the  decre¬ 
ment  is  attenuated  in  coacting  groups  in  compar¬ 
ison  to  observers  working  alone.  Of  the  earlier 
studies  on  coaction  in  vigilance,  only  Wiener 
(1964)  examined  that  possibility,  and  he  found 
that  the  decrement  was  indeed  attenuated  in  a 
coacting  group  condition  in  comparison  to  one 
involving  individual  observers.  As  was  the  case 
in  Wiener’s  (1964)  study,  the  vigilance  decre¬ 
ment  was  absent  in  the  coacting  groups  of  the 
present  experiment.  However,  it  was  also  absent 
in  the  single-observer  condition,  even  though 
previous  studies  with  the  display  employed 
herein  did  find  a  vigilance  decrement  among 
single  observers  over  the  same  time  span  (Dillard 
et  al.,  2014;  Funke  et  al.,  2011;  Shaw  et  al., 
2013).  In  the  earliest  days  of  vigilance  research, 
Jerison  (1963)  pointed  out  that  several  factors 
may  determine  the  presence  or  absence  of  the 
decrement,  a  theme  echoed  by  Davies  and  Para¬ 
suraman  (1982)  and  more  recently  by  Hancock 
(2013)  and  Thomson,  Smilek,  and  Besner  (2015). 
Accordingly,  we  are  not  sure  why  the  decrement 
did  not  appear  in  the  single-observer  condition  of 
our  study,  and  further  research  is  needed  to 
answer  that  question  and  to  determine  if  Wie¬ 
ner’s  (1964)  finding  that  the  decrement  is  mini¬ 
mized  in  coacting  groups  in  comparison  to  indi¬ 
vidual  observers  can  be  replicated. 

The  central  theme  of  the  present  study  was 
that  although  coacting  observers  might  be  inde¬ 
pendent  in  terms  of  performance  efficiency  on  a 
vigilance  task,  they  might  be  interdependent 
with  respect  to  the  workload  and  stress  associ¬ 
ated  with  that  task.  This  idea  was  based  on  the 
evaluation  apprehension  element  in  social  facili¬ 
tation  research  wherein  group  members  are  con¬ 
cerned  with  appearing  less  competent  than  their 
cohorts  (Bond  &  Titus,  1983;  Harkins,  1987). 
Consequently,  it  was  conceivable  that  this 
uneasiness  could  lead  coacting  observers  to 
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work  harder  and  thus  to  rate  the  vigilance  task  as 
having  a  higher  level  of  workload  and  stress 
than  those  who  performed  the  vigilance  task  by 
themselves,  a  result  that  would  undermine  the 
benefits  of  group  vigilance  in  the  operational 
world.  This  study  did  indeed  show  interdepen¬ 
dence  among  coacting  observers  but  not  in  the 
manner  expected. 

As  in  many  previous  studies  (e.g.,  Finomore 
et  al.,  2013;  Warm  et  al.,  1996;  Warm  et  ah, 
2015;  Warm,  Matthews  et  al.,  2008;  Warm, 
Parasuraman  et  al.,  2008),  observers  who  per¬ 
formed  the  vigilance  task  individually  in  this 
study  reported  high  levels  of  workload.  Their 
scores  on  the  NASA-TLX  fell  above  the  mid¬ 
point  of  the  scale,  and  mental  demand  and  tem¬ 
poral  demand  were  among  the  major  compo¬ 
nents  of  the  workload  of  the  task.  Workload  rat¬ 
ings  by  coacting  observers  mirrored  those  of 
individual  observers.  Accordingly,  although  the 
present  study  provides  the  initial  demonstration 
that  vigilance  tasks  induce  substantial  workload 
in  coacting  observers,  it  also  shows  that  contrary 
to  expectations  based  on  the  notion  of  evaluation 
apprehension,  their  workload  ratings  do  not  dif¬ 
fer  significantly  from  those  of  observers  work¬ 
ing  singly. 

In  regard  to  task-induced  stress,  all  observers 
in  this  study  showed  a  significant  posttest  loss  in 
task  engagement  and  a  gain  in  distress  on  the 
DSSQ.  These  results  are  consistent  with  previ¬ 
ous  findings  in  vigilance  research  with  this  scale 
involving  individual  observers  (Matthews  et  al., 
2013;  Warm,  Matthews  et  al.,  2008),  and  fur¬ 
thermore,  they  indicate  that  task-induced  stress 
also  occurs  among  observers  working  in  coact¬ 
ing  groups.  Although  the  loss  of  task  engage¬ 
ment  over  the  course  of  the  vigil  did  not  differ 
significantly  between  the  coacting  and  single 
observers,  the  task-induced  increase  in  distress 
was  significantly  less  among  the  former  than  the 
latter — an  effect  directly  opposite  to  the  expec¬ 
tation  generated  from  the  evaluation  apprehen¬ 
sion  notion. 

The  coacting  groups’  experience  of  relatively 
low  task-induced  distress  may  be  explained  by 
two  aspects  of  social  relationships  that  contrib¬ 
ute  to  psychological  security.  The  first  is  the 
finding  that  companionship  has  a  protective 
effect  on  individuals  under  stress  (Buck  &  Parke, 


1972;  Rook,  1987,  2015;  Schachter,  1959). 
Thus,  joint  presence  might  have  served  to  mod¬ 
erate  task-induced  distress  for  coacting  observ¬ 
ers.  A  second  possibility  comes  from  Wilson, 
Salas,  Priest,  and  Andrews’  (2007)  suggestion 
that  opportunities  for  backup  behavior  might 
reduce  stress  among  individual  group  members 
working  on  a  difficult  task.  Coacting  observers 
may  have  experienced  less  task-induced  distress 
because  they  were  aware  of  their  joint  responsi¬ 
bility  for  UAV  monitoring — if  one  of  them 
missed  a  signal,  the  other  might  detect  it,  avoid¬ 
ing  a  potential  mishap. 

In  sum,  the  present  study  indicates  that  both 
independence  and  interdependence  characterize 
group  dynamics  in  carrying  out  a  vigilance  task 
under  a  coaction  format.  Specifically,  the  coact¬ 
ing  groups  detected  more  signals  than  individual 
observers,  and  as  reflected  in  the  algorithm  pro¬ 
posed  by  Morgan  and  Alluisi  (1965)  and  Wiener 
(1964),  this  finding  was  the  result  of  combining 
the  simple  probabilities  of  the  individual  perfor¬ 
mances  of  the  group  members.  Additionally, 
group  membership  led  coacting  observers  to 
report  lower  levels  of  task-induced  stress  than 
observers  who  performed  the  vigilance  task 
individually. 

Accordingly,  when  system  requirements, 
facilities,  and  system  costs  permit,  the  coacting 
groups  approach  remains  a  viable  vehicle  for 
enhancing  signal  detection  in  operational  vigi¬ 
lance  settings.  Along  that  line,  it  is  important  to 
remember  that  this  study  and  all  of  the  earlier 
coacting  observer  vigilance  studies  were  basic- 
science  investigations  that  utilized  naive  observers 
in  laboratory  vigilance  tasks.  In  a  recent  review, 
Drury  (2015)  has  pointed  out  that  laboratory- 
based  findings  in  vigilance  do  not  always  gener¬ 
alize  to  operational  settings.  Consequently,  the 
next  step  in  evaluating  the  utility  of  the  coacting 
groups  approach  will  be  to  apply  it  with  sophis¬ 
ticated  observers  in  a  variety  of  specific  opera¬ 
tional  settings  such  as  those  described  in  the 
introduction  to  this  report. 
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KEY  POINTS 

•  A  group  approach  in  which  paired  observers  per¬ 
formed  coactively  facilitated  signal  detection  in  a 
vigilance  task. 

•  Coacting  group  observers  were  independent  in 
regard  to  performance  efficiency  but  interdepen¬ 
dent  in  regard  to  task-induced  distress. 

•  Postvigil  distress  indexed  by  the  DSSQ  was  sig¬ 
nificantly  less  in  coacting  group  observers  than  in 
those  who  worked  alone. 

•  As  indexed  by  the  NASA-TLX,  coacting  group 
observers  and  those  working  alone  reported 
equally  high  levels  of  workload  in  the  perfor¬ 
mance  of  the  vigilance  task. 

•  With  regard  to  performance  efficiency  and  stress, 
the  results  of  this  study  support  the  possibility  of 
using  coacting  groups  to  enhance  signal  detection 
in  operational  vigilance  settings. 
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